This Page Is Inserted by IF W Operations 
and is not a part of the Official Record 

BEST AVAILABLE IMAGES 



Defective images within this document are accurate representations of 
the original documents submitted by the applicant. 

Defects in the images may include (but are not limited to): 



BLACK BORDERS 

TEXT CUT OFF AT TOP, BOTTOM OR SIDES 
FADED TEXT 
ILLEGIBLE TEXT 
SKEWED/SLANTED IMAGES 
COLORED PHOTOS 

BLACK OR VERY BLACK AND WHITE DARK PHOTOS 
GRAY SCALE DOCUMENTS 



IMAGES ARE BEST AVAILABLE COPY. 



As rescanning documents will not correct images, 
please do not report the images to the 
Image Problem Mailbox. 



JUN.30.2003 3:22PM 



NO. 936 P. 3/30 



SPECIFICATION 
TITLE 

"METHOD AND COMPUTERIZED SYSTEM FOR AUTOMATICALLY 
PROCESSING STUDIES ACQUIRED BY AN IMAGING EXAMINATION SYSTEM " 

BACKGROUND OF THE INVENTION 

Field of the Invention 

The present invention is directed to a method for automatically processing 
studies acquired by an imaging examination system as well as to a corresponding 
computerized system for the implementation of such a method. 
Description of the Prior Art 

A number of diseases can be recognized early and treatment measures 
initiated in time with the assistance of modem imaging examination systems such as, 
for example, magnetic resonance tomography systems, computer tomography 
systems, X-ray devices or ultrasound devices. Particularly pathologies such as 
coronary heart diseases, lung cancer or colon cancer, which are among the most 
frequent causes of death in the industrialized world, often can already be detected in 
a very early stage especially with tomographic examination methods such as 
magnetic resonance tomography or X-ray computed tomography. Regular 
preventative examinations even of non-symptomatic persons with such methods 
therefore could certainly considerably improve the chances of curing these diseases, 
Unfortunately, however, such examinations involve relatively high costs. Among the 
reasons for these high costs are the very large quantities of image data that arise as 
well as the time that is required for a finding by a radiologist. Dependent on the type 
of examination, for example dependent on whether it is a simple examination or a 
comparative examination with and without administration of contrast agent, one or 
more measurement series, referred to as studies, are acquired for an examination of 
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a patient. Each of these studi s is composed of at least one image, and usually is 
composed of a number of images from various slices of the examination subject. It 
can be assumed in a rough estimate that image that, for example, are stored in the 
DICOM standard (Digital Imaging and Communication) and are composed of an 
image header, which contains the information about the patient, the exposure 
location, the exposure time, etc., and include of the gray scale information that 
represent the actual image, with a data volume of approximately 200 KB. Given the 
assumption that a total of 1800 images are to be acquired for a complete screening 
of a patient in a magnetic resonance tomography system given a body height of 1.80 
m for the patient and one image per mm, one such examination leads to a data 
quantity of 360 MB. Dependent on the type of examination, It may be necessary 
under certain conditions to not only process these images themselves in order to 
perform" a finding for the study; rather, but also the images may have to be 
compared, for example, to images of preceding studies from other examinations. 
The quantity of data and the required time are correspondingly increased. One 
solution for reducing the costs, particularly in screening examinations, would be to 
make findings in an automated manner. At least the required work time of the 
radiologist thus can be reduced, since the radiologist would only have to be available 
only in cases that seem to be critical and/or for a possible spot-check monitoring of 
the findings. In practice, methods and computer systems already exist for 
automatically processing studies of imaging examination systems, including a 
complete evaluation, i.e., for example, a finding of the studies. 

One problem of such automatic processing or finding, however, is the high 
computing capacity required therefor, since computing methods for such radiological 
applications require a very large number of processor operations, i.e. computing 
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operations, comparison operations or the like, as well as a very large number of data 
bank queries at different data banks, even on different computers. Particularly in the 
case of comparison to studies of earlier examinations, extremely large quantities of 
data must be loaded, for example from an archive server that contains the historical 
data. The required operations and the transport of the data quantities burden the 
appertaining computer as well as the network to which the computer and the archive 
server are connected to a significant extent. Given a number of automatic findings 
by a computer, in particular, there is the risk that current operation on the 
appertaining examination system also will be affected and the examination durations 
therefore will be lengthened. Particularly given examinations wherein a fast finding 
Is necessary, for example given an examination of patients with a suspected cardiac 
infarction or stroke, this can lead to critical delays. Moreover, longer examination 
times are relatively uncomfortable for the patient. Finally, longer examination times 
lead to a lower workload for the relatively expensive examination systems, which 
again indirectly involves higher costs. 

SUMMARY OF THE INVENTION 

It is an object of the present invention to provide a method and an imaging 
system for automatically processing studies of imaging examination systems with 
which an economical, automatic evaluation of the studies is possible and 
disadvantages thereby do not arise for applications that require fast answers. 

In terms of the method, this object is achieved by allocating a priority code 
allocated to the studies acquired by an imaging examination system and, dependent 
on the priority code, the appertaining study is either processed immediately on a first 
computer allocated to the appertaining imaging examination system or the study (or 
the image data and other data of this study) is first intermediately stored in a memory 
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device for a later processing, and an identifier allocated to the study is ther by stored 
in a processing job list. At later points in time, the studies with identifiers stored in 
the processing job list are processed according to a predefined sequence. The first 
computer has further computers allocated to it that are connected to the first 
computer via a network, and the availability of the allocated, further computers is 
checked and - insofar as one of the allocated computers is available for a 
processing of the study - an intermediately stored study is communicated to the 
appertaining, allocated computer, which receives and automatically processes the 
study. 

The allocated, first computer can be, for example, the host computer of the 
examination system itself, for example an MR scanner. It can also be a central 
computer of a clinic system or of a practice system that is usually responsible for the 
processing of the studies of this imaging examination system. 

The identifier can be an arbitrary data string or dataset that allows the 
identification of the study intermediately stored in the memory device, i.e. the image 
data and other data stored thereat that belong to the study. For example, this can be 
an identification number and/or the name of the patient, the date of the exposure or 
the examination device. The processing job list then contains this identifier, possibly 
in common with the priority code, in a form that allows the coordination of the 
processing of the individual studies. Such a processing job list can be implemented 
such that a newly added study or the identifier thereof is attached to the end of the 
list and the priority code also may be attached. A sorting according to priority codes 
also can ensue, or a number of partial lists for studies with different priority codes 
can be maintained. In this respect, the term "processing job list" also includes a data 
bank that allows a corresponding supervision and administration of the processing 
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jobs that are still pending. The processing job list can be supervised by the first 
computer itself, or by a second computer connected thereto, for example by a central 
computer of a clinic system or practice system. 

The sequence of the processing of the studies whose identifiers are stored in 
the processing job list can be prescribed dependent on the local conditions and 
requirements. The processing preferably ensues taking the allocated priority codes 
into consideration and otherwise ensues in sequence, i.e. based on how old the 
acquisition time of the study is. 

The availability check wherein a determination is made as to whether an 
allocated, further computer is available for processing a study, preferably includes 
not only the check as to whether a corresponding computer with the required 
capacity is activated at all and can accept data but also includes a workload check of 
the allocated computer. 

The implementation of this method requires a computer system that at least 
includes a first computer connected to an imaging examination system, a number of 
further computers that are allocated to the first computer and connected to one 
another as well as to the first computer via a network, as well as priority allocation 
unit for allocating a priority code to a study acquired by the imaging examination 
system. The first computer and the allocated computers must include means for the 
automatic. processing of studies_of imaging examination. systems. The first computer. .. 
must also be fashioned such that the study is immediately processed on that 
computer given certain priority codes and such that the study is otherwise deposited 
in a memory device. At least one of the computers belonging to the computer 
network - this can be the first computer itself or a further computer, for example a 
central computer - must include means for storing an identifier allocated to the 
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appertaining study jn a processing job list for the studies stored in the memory 
device and for initiating processing of the studies. This is undertaken by checking 
the availability of the allocated computers and communicating of an intermediately 
stored study to the appertaining, allocated computer, ensues insofar as one of the 
allocated computers is available for processing a study. 

The allocated computers can be arbitrary computers that are available via the 
network, for example a hospital or practice Intranet or the Internet, either at a 
specific, current point in time, regularly at defined times, for example always at night, 
or are available for outsourced computing jobs. In particular, these can be 
computers that are respectively allocated to specific imaging examination systems 
and usually process the studies that were acquired on their "own" Imaging 
examination systems. Insofar as these computers have no data to process from the 
imaging examination system that is allocated to them, they are fundamentally 
available for processing other computing jobs. 

If as the network is a matter of a larger network, for example an intranet of a 
chain of practices or of clinics connected to one another, or the Internet, it is also 
possible for the various practices or clinics that are connected to the network to 
make computing capacities that are not currently needed available to one another. 

The priority code of the study can already be entered by the examining 
personnel when a patient checks in for an examination. To this end, the priority 
allocation means must include a user interface for the entry of a priority code for a 
specific study or for a complete examination composed of a number of studies, so 
that this priority code is then assigned to the individual studies. 

In an alternative, preferred exemplary embodiment, the priority codes are 
automatically assigned dependent on the study. To this end, for example, the 



JUN.30.2003 3 :24PM 



NO. 936 P. 9/30 



priority allocation means can include a memory with a list of study types, each 
having a priority code is assigned thereto. The term "study type" as used herein 
defines the purpose for which the study is implemented, I.e. the priority is defined by 
the formulation of the reason for the examination. For example, it must usually be 
assumed that a very high priority is established for examinations due to a suspected 
cardiac infarction or stroke or similar acute problems, since an immediate processing 
of such a study must ensue. In contrast, follow-up examinations for confirming 
earlier examinations or for monitoring the progress of tumor patients, etc., should 
have a medium priority, so that results are available within a few days. Mere 
screening examinations for non-symptomatic patients, in contrast, can be processed 
with a low priority since the time until the finding is produced following the 
examination is usually not critical. 

In a preferred method, an automatic pre-evaluation of at least a part of the 
study, for example of some of the images or of an individual overview image such 
as, for example a tomogram in a CT examination, ensues first. A priority code is 
then assigned dependent on pre-evaluation data of the study that are thus 
determined. Such a pre-evaluation also can ensue even if a priority code already 
was previously assigned. A new priority code is then assigned insofar as necessary 
on the basis of the pre-evaluation data that are determined. One example of this is a 
very brief pre-evaluation of purely preventative studies requiring only little calculating 
time in order to determine whether an indication of an anomaly can be found in the 
evaluated part of the study. The study is provided with a higher priority and 
completely processed correspondingly faster only when such anomalies are 
indicated within the evaluated material. For example, an analysis of the appertaining 
image or of the image series in view of specific features and/or the transgression of 
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certain defined limit Values, for example a maximum grayscale value within or in a 
specific region of the image that could indicate pathological changes, can ensu in 
the pre-evaluation, 

A requirement for this purpose is that the computer system - preferably the 
first computer that is allocated to the imaging examination system - include a pre- 
evaluation device that first implements the automatic pre-evaluation of at least a part 
of the study and communicates the pre-evaluation data that are thereby determined 
to the priority allocation unit. The priority allocation unit must assign a priority code 
dependent on the pre-evaluation data of the appertaining study, or re-assign a 
priority code insofar as necessary if a priority code was already assigned. This pre- 
evaluation device preferably has a corresponding image processing unit for the 
implementation of a feature analysis* 

In order to check the availability of the allocated computers, the workload of 
the processors or of the CPUs of the allocated further computers is preferably 
interrogated at regular time intervals. Classification can be made, for example, 
according to workloads of below 10%, below 50% and above 50%. Insofar as the 
workload lies below 10%, this is interpreted as the standby mode of the appertaining 
computer. A workload below 50% is considered light and a workload above 50% is 
considered heavy. Studies then are sent only to no-load computers or computers 
with a light workload, with no-load computers being used with priority. 

The outsourced job orders are then processed on the respective computers 
with a low absolute priority, so that it is assured that local work processes that may 
arise are not impeded. 

To avoid the network from being too heavily loaded by unnecessary data 
transmission, the traffic load of the network is measured, preferably at regular time 
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intervals and/or before a transmission. A transmission of th study to the allocated 
computer then ensues only when the network traffic load does not exceed a 
predefined threshold. To this end, the computer system must have a unit for 
measuring the traffic load of the network. 

The computer system preferably has a central computer that supervises the 
processing job list and checks the traffic load of the network as warranted and that 
initiates the transmission of an intermediately stored study to an available computer. 
It is assured in this way that the distribution of the jobs occurs in as coordinated a 
manner as possible to the available computer capacities. 

It is also possible for the individual computers allocated to the various imaging 
examination systems to talk to one another and "lend" computing time to one another 
insofar as their capacities are not fully utilized. In this case, as well, however, one of 
the computers preferably assumes the supervision of the processing job list and thus 
assures the coordination. 

It Is meaningful that interrelated studies are also processed In common with 
the same priority, preferably on the same computer at the same time, or 
successively. These include, for example, studies that belong to one examination or 
to various examinations of the same patient or that belong together as comparative 
examinations, for example for medication studies. 

DESCRIPTION OF THE DRAWINGS 

Figure 1 is a schematic illustration of an inventive computer system. 

Figure 2 is a flowchart of an embodiment of a sequence from the patient 
admission through the processing of a study according to the Inventive method. 
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DESCRIPTION OF THE PREFERRED EMBODIMENTS 

The computer system shown in Figure 1 includes a total of four Imaging 
examination systems 11, 12, 13, 14, also referred to as modalities below, that are 
each directly connected to an allocated computer 1, 2, 3, 4. These computers 1, 2, 
3, 4 serve for driving of the respective modalities 11, 12, 13, 14 and for processing 
the studies generated by the modalities 11, 12, 13, 14, particularly for evaluation or 
findings thereof. The individual computers 1, 2, 3, 4 of the modalities 11, 12, 13, 14 
are respectively connected to one another via a network 10, for example a bus 
system. 

A memory 6 for storing and archiving the studies also is connected to the 
network 10. Further, a central computer 5 Is connected to the network 10, the 
central computer 5 serving as a network server and likewise making computer 
capacities available for processing studies. This central computer 5 also serves for 
the administration of the memory 6 in the exemplary embodiment. 

Moreover, picture screen workstations 7, 8, for example in the form of PCs or 
workstations, are connected to the network 10, these likewise allowing a processing 
of image data, especially a sorting or finding by operating personal and, for 
example, also being able to be used for the check-in of a patient before an 
examination. 

The patient data that are entered at such a picture screen workstation 7, 8 are 
communicated via the network 10 to the computer 1, 2, 3, 4 that is responsible for 
the modality 11, 12, 13, 14 at which the respective patient is to be examined. 
Moreover, the data also may be handed over to the network server 5 and deposited 
in the memory 6 of the system. 
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Finally, a printer 9 is connected to the network 1 0 for printing out patient data 
as well as examination results such as, for example, images or findings. 

It should be noted that the illustrated network 10 is only an exemplary 
embodiment and that a network for the implementation of the inventive method can 
have a completely different architecture. For example, a number of modalities can 
be allocated to a shared computer. Likewise, the modalities can be directly 
connected to the network and communicate with the respectively allocated computer 
via the network. Further, it is also possible for an individual modality to be directly 
allocated to multiple computers that are specifically provided for processing the data 
of this modality. It is also clear that considerably more or fewer modalities can be 
connected to the network. Likewise, a number of different memory devices as well 
as a number of mainframe computers and a higher number of image workstations 
and printers can be connected to the network. In particular, it is also possible for the 
network to be connected to a larger network, for example the Internet, via a 
corresponding interface and thus in turn can be connected to further computers or 
local networks. 

All standards suitable for radiological information systems (RIS) or for image 
information systems (PACS, Picture Archiving and Communication System) such as, 
for example, the standards OSI, TCP/IP, DICOM and IPI often employed in 
radiological information systems, can be employed for the communication of the 
images and the administrative data for the examination of patients. 

The tasks of the individual components are explained below with reference to 
an exemplary embodiment on the basis of the flowchart in Figure 2. This flowchart 
shows the method sequence from the check-in of the patient through the processing 
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of a study generated in an examination of the patient. This is a m thod execution 
that is implemented on various components connected to the network 10. 

The method begins in method step I with the check-in of the patient, for 
example at one of the picture screen workstations 8. The personal data of the 
patient are recorded at this picture screen work station 8, and the examination that is 
to be implemented is specified, for example an acute examination, a follow-up 
examination or a screening examination. Such data are then communicated to a 
computer 1 that is allocated to the modality 1 1 that is provided and reserved for the 
examination. At the same time, the patient receives the instruction to report to this 
modality 1 1 , a magnetic resonance tomograph here, whereupon the patient goes to 
that location. 

In addition to the standard tasks that are then handled on the allocated first 
compute'r 1 of the modality 11 before an examination, a priority code P is also 
defined. This can ensue by input by the personnel with the user interface of the first 
computer 1 composed of a keyboard 16 and a picture screen 17. The definition of 
the priority code P, however, preferably already ensues automatically in a priority 
allocation module 18 that is realized in the form of software on the appertaining 
computer 1 . 

This priority allocation module 18 contains a study type list SL in which 
various priority codes P are defined for various study types SA (or examination 
types). Screening examinations of non-symptomatic patients are thus assigned the 
priority code "4", examinations of medication studies a priority code "3", follow-up 
examinations for monitoring tumor patients the priority code "2" and other types of 
studies the priority code "1". Here, "1" represents the highest priority that demands 
an immediate processing of the studies. These therefore include all acute 
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i 
: 

i 

examinations that are not explicitly referenced in the study list SL. In this respect, 
the study type list SL contains only an exclusion list of examinations for which an 
immediate processing of the studies generated in the examination is usually not 
initially required. 

The priority allocation module 18 then automatically determines the type of 
study involved and assigns the priority code P in conformity therewith. Alternatively, 
it is also possible that the priority allocation is already implemented - either manually 
or automatically on the basis of the study type - at the picture screen work station 8 
at which the patient check-in ensued. 

i 

After the priority code has been determined in method step II, the examination i 

i 

then ensues in method step III. 

Subsequently, a check is made in method step IV to determine whether a 
priority code P is present that requires an immediate processing of the study, a * 

i 

priority code "1" here. When this is the case, then the study is immediately j 

i 

processed in method steps V and VI, whereby a finding occurs first in method step V 
and the finding is output and/or stored in method step VI. The storage of the finding ! 
within the memory 6 preferably ensues in common with the appertaining 
administrative data and the image data of the patient produced in the study. For 
example, the output of the finding can ensue at the picture screen 17 of the 
computer 1 and/or via the printer 9. Subsequently, the procedure is ended in 

i 

method step VII. 

When, in contrast, it is found in method step IV that the priority code P in the . 
present case is not "1", i.e. an immediate processing is not needed, then the study is 
handed over to the central computer 5 in method step VIII, which first causes an 
intermediate storage of the study in the memory 6 in the following methods step IX. 
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Moreover, an identifier K with which the study can be unambiguously identified, is 
entered Into a processing job list BL in method step X. 

In an alternative embodiment not shown in Figure 2, a relatively short pre- 
evaluation that requires only little computing time is also initially implemented in a 
pre-evaluation module 19 realized in the form of software on the first computer 1 for 
specific studies with a lower priority, for example mere preventative studies, in order 
to determine whether an indication that an anomaly may be found in the evaluated 
part of the study. When such anomalies are indicated within the pre-evaluated 
material, the study is subsequently provided with a priority code of "1" and, 
accordingly, is immediately completely processed. 

The intermediately stored studies, the respective identifier K of which are 
stored In the processing job list BL, are then processed in the following way: 

In method step XI, the central computer 5 regularly checks whether a pending 
job is present in the job order list BL. 

When this is the case, then a check is made in method step XII to determine 
whether a computer is available and whether the network 10 is overloaded. For 
checking the availability, the central computer 5 checks the workload of the CPUs of 
all allocated computers 2, 3, 4 available for a processing of studies at regular time 
intervals. It can also additionally take into consideration the first computer 1 from 
which the appertaining job originally came and also allocate a work job to it insofar is 
it does not have a full workload at a later point in time. The central computer 5 
preferably is likewise equipped with means to automatically process studies, i.e., it 
can itself process studies pending in the processing job list insofar as it does not 
have too heavy a workload. 
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The workload of the computers is classified into three categori s. it is 
assumed below a 1 0% workload that the respectively computer has no load and, for 
example, Is in a standby mode. A low workload is assumed given less than 1 50% 
workload and a high workload is assumed given a workload of more than 50%. 

The check of the availability and the monitoring of the processing job list BL 
ensues with the assistance of a job monitoring module 15 that is implemented on the 
central computer 5 in the form of suitable software. The computers that can be 
fundamentally available for processing studies, i.e. the allocated computers, are 
presented to the central computer 5 in a computer list RL. Insofar as the network is 
expanded, it is merely necessary to enter this newly added computer in the computer 
list RL. 

The network occupancy, i.e. the performance of the network 10, can be 
checked in a relatively simple way, for example, by the central computer 5 sending a 
test signal to a further computer component connected to the network 10, this further 
computer component replying to this test signal. When measures are implemented 
to insure that the reaction time of the replying computer component is itself relatively 
short, then the time until receipt of the reply signal at the central computer 5 is mainly 
dependent only on the occupancy of the network 10. For this reason, the test signal 
to be answered is preferably sent to a component that has only a low workload, for 
example to the printer 9. A typical example of a transmission of a signal to be 
answered is referred to as the 'ping* function in a Unix network. When the measured 
reply time lies above a certain threshold, then it is assumed that the network 1 0 is 
overloaded and no studies whatsoever are handed over from the memory 6 to the 
allocated computers for processing. This check of the network performance can 
ensue at regular time intervals - nearly permanently as well - or every time when a 
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transmission of more extensive study data is planned. To this end, a network 
occupancy module 20 is implemented on the central computer 5 in the form of 
suitable software that collaborates with the job-monitoring module 15. 

If it is found in method step XII according to Figure 2 that a computer is 
available and that the network is not overloaded, a study from the buffer memory 6 is 
sent to the appertaining computer in method step XII, to a computer 2 allocated to a 
different modality 12 in this case. The computer 2 then implements the automatic 
finding in method step XIV. In method step XV, the finding is in turn output, for 
example at the printer 9, and stored in the memory 6. Subsequently, the processing 
is ended in method step XIV, and the appertaining computer 2 is available again for 
accepting further job orders from the central computer 5. ■ 

The job order assigned by the central computer is processed with only a 
relatively low absolute priority on the appertaining computer 2, so that a processing 
of jobs currently coming from its own modality 12 does not incur any time 
disadvantages. 

The computer capacities of the entire computer system are optimally used by 
means of the inventive method without incurring delays in applications that require a 
fast reply time. In this way, the costs can be lowered, particularly for those 
examinations that are not time-critical such as, for example, preventative 
examinations, so that these can ultimately be financed to a greater extent as a 
preventative examination even for non-symptomatic persons. The invention, 
moreover, is not limited to employment in the medical field but also can be utilized in 
other fields where there is a demand for an automatic processing of studies of 
imaging examination systems such as, for example, in the case of materials 
inspection devices. 
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Although modifications and changes may be suggested by those skilled in th 
art, it is the intention of the inventors to embody within the patent warranted hereon 
all changes and modifications as reasonably and properly come within the scope of 
their contribution to the art. 
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